Incorporating the Sympson-Hetter Exposure Control Method into the a-Stratified Method with Content Blocking

نویسنده

  • Qing Yi
چکیده

Previous research (e.g., Leung, Chang, & Hau, 2001; Yi & Chang, 2001) has shown that the astratified method with content blocking (STR_C) performed well in content balancing constrained computerized adaptive tests (CATs). It effectively reduced the exposure rates of highly discriminating items, produced more balanced item usage within a pool, and maintained measurement precision. This method, however, does not have a mechanism that can fix (prespecify) the maximum item exposure rate. In the current study, the Sympson-Hetter exposure control procedure (Sympson & Hetter, 1985) was incorporated into STR_C (denoted STR_CSH). Under content balancing constraint conditions, this study investigated the effectiveness of STR_C-SH by comparing the STR_C-SH procedure with the original STR_C method and the maximum information selection method with Sympson-Hetter exposure control (MI-SH). This study also examined the effects of the test length, the number of strata, and the pre-specified maximum item exposure rate on the performance of each method. The results of this study have shown that STR_C-SH is an effective item exposure control method for CATs with practical content constraints. Incorporating the Sympson-Hetter Exposure Control Method into the a-Stratified Method with Content Blocking

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Content Balancing in Stratified Computerized Adaptive Testing Designs

For computerized adaptive testing (CAT) programs that adopt three-parameter logistic model, high discriminative items generally provide more information for trait estimation. The information based item selection methods in administering computerized adaptive tests (CATs) tend to choose the item that provides maximum information at an examinee’s estimated trait level. As a result, these methods ...

متن کامل

Implementing the a-Stratified Method with b Blocking in Computerized Adaptive Testing with the Generalized Partial Credit Model

The purpose of the current study was to generalize the use of the a-stratified method with b blocking (Chang, Qian, & Ying, 2001; denoted STR_B) to computerized adaptive testing (CAT) with the generalized partial credit model (Muraki, 1992). Chang et al. (2001) showed that STR_B performs well in reducing highly discriminating items' exposure rates and increasing lower a items' usage while maint...

متن کامل

a-Stratified CAT design with content blocking.

Content balancing is often required in the development and implementation of computerized adaptive tests (CATs). In the current study, we propose a modified a-stratified method, the a-stratified method with content blocking. As a further refinement of a-stratified CAT designs, the new method incorporates content specifications into item pool stratification. Simulation studies were conducted to ...

متن کامل

Constrained Item Selection Using a Stochastically Curtailed SPRT

Computerized classification testing (CCT) provides the means to increase efficiency in educational testing. The stochastically curtailed sequential probability ratio test (SCSPRT) (Finkelman 2003, 2004, 2008) has been tested as an efficient alternative to the most frequently used decision algorithm in CCT for mastery testing, the sequential probability ratio test (SPRT). However, in order to be...

متن کامل

Rotating item banks versus restriction of maximum exposure rates in computerized adaptive testing.

If examinees were to know, beforehand, part of the content of a computerized adaptive test, their estimated trait levels would then have a marked positive bias. One of the strategies to avoid this consists of dividing a large item bank into several sub-banks and rotating the sub-bank employed (Ariel, Veldkamp & van der Linden, 2004). This strategy permits substantial improvements in exposure co...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2003